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INTRODUCTION 

In  this  paper,  we  present  a  branch- and-bound  algorithm  for  obtaining 
optimal  NOR  networks  [3,  ^-1  •   This  algorithm  differs  from  Davidson's  in  the 
inclusion  of  the  following  two  new  features;  i.e.,  (i)  an  efficient  pruning 
of  non-optimal  networks  and  (ii)  a  different  branching  strategy  for  enumer- 
ating feasible  networks.   The  feature  of  pruning  non-optimal  networks  is 
based  on  the  construction  of  better  networks  by  eliminating  redundant  gates 
and  connections  of  the  networks  which  the  enumerative  part  of  the  branch- 
and-bound  algorithm  generates;  we  call  this  feature  the  redundancy  check 
The  principle  of  our  branching  strategy  is  based  on  an  attempt  to  minimize 
the  width  of  the  search  tree  of  the  branch- and-bound  algorithm. 

We  present  in  section  1  the  scheme  of  the  redundancy  check  which  we 
incorporated  into  our  computer  program  of  the  branch-and-bound  method, 
called  ILLOD-(NOR-B)  (Illinois  LOgical  Design  with  NOR-gates  by  Branch- 
and-bound  method ) . 

In  section  2,  we  describe  the  branching  strategy.   (The  entire 
algorithm  of  the  branch-and-bound  method  is  presented  in  the  paper  [3].) 
For  comparison,  we  summarize  the  differences  in  branching  strategy  be- 
tween Davidson's  algorithm  and  ours,  and  present  some  computational  results 
with  both  versions. 

Section  3  contains  computational  experiments  comparing  Davidson's 
branching  strategy  with  the  combination  of  our  branching  strategy  and  the 
gimmick  of  the  redundancy  check.   The  results  include  some  6-,  J-f   and 
8-gate  functions  of  four  variables,  among  others. 


1.    A  METHOD  OF  REDUCING  THE  NUMBER  OF  REDUNDANT  GATES  AND  CONNECTIONS  t 
IN  NON-OPTIMAL  NOR  NETWORKS 

1.1   Elimination  of  a  Redundant  Connection 

Suppose  we  are  given  NOR  gates  p,  q,  ... ,   t  which  are  cascaded  as 
shown  in  Fig.  1.1.   Let  us  call  this  configuration  a  gate- chain. 


F     ^^   F 


*'t      V7 


Fig.  1.1  A  gate-chain  consisting  of  gates  p,  q,  ...,  s,  t. 

Let  g  denote  the  input  under  consideration  which  is  connected  to  gate  p. 

Let  f  ,'s  be  the  inputs  to  gate  p  other  than  the  input  g;  Let  f  ,'s  be  the 
pi  qj 

inputs  to  gate  q  from  outside  of  the  gate-chain;  and  let  f  's  be  the  in- 

tK 

puts  to  gate  t  from  outside  of  the  gate  chain. 

Property  1 

In  the  above  gate- chain,  the  input  g  is  redundant  with  respect  to 
the  output  of  gate  t,  if  and  only  if  g  implies  the  disjunction  of  the 

Vs'  Vs'  •••' and  Vs'  i-e- 

(fpl  V  fP2  -  -%  -  fq2  -  ••') (ftl  -  ft2  -  •••>  -  S  (1'1)- 


+     The  word  'connection'  denotes  either  an  input  connection  from  an  ex- 
ternal variable  or  an  interconnection  between  two  gates,  unless  other- 
wise specified. 


Proof 


Let  $  ,  0  ,  ....  and  <3>,  denote  the  disjunctions  of  f  . 's,  f  .'s,  .... 

and  f  '  s,  respectively.   The  outputs  of  gates  in  the  gate-chain  are  given' 
recursively  as  : 


*\ 


the  output  of  gate  p:  F 


the  output  of  gate  q:  F  =  F  $    >        (1.2). 

q         P     q       / 


the  output  of  gate  t:      F ,    =  F     <£>. 

t  S       "C 


Assume  that  the  input  g  is  disconnected  from  gate  p.     The  output  of  gate  p 

changes  from  I  $p     to    5p.     This  change  propagates  toward  gate  t.      let 

Ff       F' ,    ....   and  F'       denote  the  outputs  of  gates  in  the  gate-chain  after 

p         q/  '  t  ~ 

the  disconnection  of  the  input  g  from  gate  p: 

F'    =  $  ,    F'      =  F'cf>      ,        ....    and  F'        =  F,(&,    • 
P         P       q  P   q  '  t  st 

The  input  g  is  redundant  with  respect  to  the  output  of  gate  t  if 
F,  =  F'  holds.   The  relation  F.  =  F!  is  equivalent  to  F.@P!  =  0. 

t  t  t  t  T,     -  U 

By  substituting  F     i     and  F'    $t  for  Ft   and  F.J.,    respectively,    we  have 

F    (+\F*    =  $     (F    £PiF'    )    =  $     (F    ff)F'    ).      Continuing  a  similar  sub- 
t  • J    t         t       s w    s  t       s  w    s 

stitution  process  backwards  to  gate  p,   we  have  0=F     9-  F •      =     0     •••$  cf>     g. 

t  t  "C  (J  p 

Therefore  0     0     •••   $  *g  =0     or  equivalently,   $     v  0     v...    v$,    3g, 
pq  t  &        '  H  Pq.  t-& 

Q.    E.    D. 
Note  that  even  if  the  above  network  consists   of  a  single  gate  p,   the 
property  still  holds. 

Suppose  an  input  g  is  connected  to  gate  p,  which  in  turn  feeds  gate 


t  through  a  subnetwork  a   in  which  there  are  two  or  more  paths  connecting 

gate  p  to  gate  t  (Fig.  1.2). 


Fig.  1.2  An  output  g  is  connected  to  gate  p,  which  in  turn  feeds 
gate  t  through  a  subnetwork  a. 


In  this  case  no  simple  expression  such  as  (l.l)  is  found  as  a  necessary 

and  sufficient  condition  for  g  to  be  redundant  with  respect  to  the  output  of 

gate  t.   Let  us  introduce  a  function  h*  [g]  with  respect  to  g  and  the  pair 

pt 

of  gates  p  and  t: 

hP*t  W  =  Ft  *  Ft  (1.3), 

where  F  is  the  output  of  gate  t  before  disconnecting  g  from  gate  p,  and 
F'   is  the  output  of  gate  t  after  dicormecting  g  from  gate  p.   Clearly 

h*  [g]  =  0  is  a  necessary  and  sufficient  condition  for  g  to  be  redundant 

pt 

with  respect  to  the  output  of  gate  t.   Notice  that  in  the  case  of  h*  [g]  =£  0, 

the  true  vectors  of  h*  [g]  are  the  input  vectors  for  which  the  output  of  gate 

pt 

t  changes  when  g  is  disconnected  from  gate  p. 

For  later  use,  let  us  derive  the  following  two  sufficient  conditions 
for  g  to  be  redundant  in  Fig.  1.2  by  using  Property  1.   The  proof  is  omitted 
since  it  is  easy  to  see  from  the  proof  of  Property  1. 


Property  2 

Take  a  gate-chain  among  paths  from  gate  p  to  gate  t  in  Fig.   1.2.     Let 
the  labels  p,   q,    . ..,  t  denote  the  gates  on  this  gate-chain  (Fig.   1.3). 


a  subnetwork  a 


Fig.  1.3  A  gate-chain  from  gate  p  to  gate  t  in  Fig.  1.2. 


When  0  sy  <t>    v  . . .  v-  $  =■>  g  holds,  we  say  the  input  g  is  redundant  with 
respect  to  the  output  of  gate  t  along  this  gate-chain,  where  <£>,<!>,  . . . , 
and  0,  are  the  disjunctions  of  inputs  originating  outside  of  a  to  gate  p, 
gate  q,  ...,  and  gate  t,  respectively.   The  input  g  is  redundant  with  re- 
spect to  the  output  of  gate  t  if  g  is  redundant  (with  respect  to  the  out- 
put of  gate  t)  along  every  gate-chain  connecting  gate  p  to  gate  t. 

Property  3 

As  a  special  case  of  Property  2  (Property  3  is  mentioned  later  more 

often  than  Property  2),  if  0  v  $  z>  g  holds,  then  g  is  redundant  with  re- 

P    t  — 

spect  to  gate  t  (Fig.  l.k). 


Fig.  l.k     If  $  v 
P 


$, ^  g  holds,  then  g  is  redundant  with  respect  to 


gate  t,   where  <E>  is  the  disjunction  of  inputs  (excluding  g) 
to  gate  p,  and  $,  is  the  disjunction  of  inputs  to  gate  t 
originating  outside  of  the  subnetwork  a. 


Let  us  show  two  examples*  of  redundant  connections  which  can  be  detected 
in  a  given  network  due  to  Property  3« 


Example  1  (Triangular  interconnection) 


Suppose  we  are  given  a  network  in  which  gate  i  is  connected  to  two 
;ates  p  and  t,  and  gate  p  has  only  one  output  connection  which  goes  to 
;ate  t  (Fig.  1.5). 


gate  p  has  no  other 
output  connections. 


Fig.  1.5  A  triangular  interconnection. 


These  are  known  as  a  triangular  interconnection  and  a  generalized 
triangular  interconnection  in  [8]. 


In  this  configuration,  the  connection  from  gate  i  to  gate  p  is  redundant. 
This  is  a  special  case  of  Property  3  where  the  subnetwork  between  gates 
p  and  t  consists  of  only  a  single  connection.   Notice  that  a  similar  prop- 
erty holds  when  gate  i  is  replaced  by  an  external  input  x  . 

Ju 

Example  2   (Generalized  triangular  interconnection) 

Suppose  we  are  given  a  network  in  which  gate  i  is  connected  to  a 
certain  subnetwork  a,  and  to  one  other  gate,  gate  t.   Furthermore,  all 
output  connections  from  the  subnetwork  o   go  to  gate  t,  but  not  to  other 
gates  (Fig.  1.6). 


no  output  connection 
to  other  gates. 

Fig.  1.6  A  generalized  triangular  interconnection. 

In  this  configuration,  all  input  connections  from  gate  i  to  the 
subnetwork  a   are  redundant. 

1.2  Elimination  Of  A  Gate  ffy  Substituting  For  Its  Output  Connections  A 
Disjunction  of  Other  Gate  Outputs  And/ Or  External  Variables 

Suppose  we  are  given  a  network  in  which  the  outputs  of  two  gates  are 
identical.   Obviously,  if  there  was  no  fan-out  restriction,  we  could  always 
substitute  for  the  output  connections  of  one  gate  the  output  connections  of 
the  other  gate  and  eliminate  one  gate  and  all  its  input  connections  (Fig.  1.7) 


;^©  :■ 


» 


Eliminate  gate  i 

and  all  inputs  to  gate  i 

(b) 


Fig.  1.7  If  the  output  of  gate  i  is  identical  to  the  output  of 
gate  p  in  (a),  then  a  better  network  is  possible  as 
shown  in  (b). 


Similarly,  if  a  disjunction  of  certain  external  variables  and/or 
outputs  of  other  gates  is  found  to  be  identical  to  the  output  of  a  gate, 
then  we  can  substitute  for  the  output  connections  of  this  gate  the  sum 
of  those  external  variables  and/or  outputs  of  gates,  eliminating  one  gate 
(Fig.  1.8).   (The  total  number  of  connections  could  increase  in  this  case.) 


» 


*©c._ 


:-^£^U©C. 
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Eliminate  gate  i  and  all 

inputs  to  gate  i 

(b) 


Fig.  1.8  If  the  output  of  gate  i  is  identical  to  the  disjunction  of  the 
outputs  of  gate  p  and  gate  q  in  (a),  then  we  can  obtain  an 
equivalent  network  having  one  less  gate  as  shown  in  (b). 


1.3  Elimination  Of  A  Gate  Having  A  Single  Output  Connection  By  Intro- 
ducing New  Connections 
Suppose  gate  i  has  only  one  output  which  is  connected  to  gate  p  as 

input  g.   Let  0  denote  the  disjunction  of  inputs  to  gate  p,  excluding  g. 

Assume  that  <t>     ^  g  does  not  hold.   (if  $  3  g  holds,  we  can  eliminate  the 
p  —  °  p  — 

input  g  as  explained  in  1.1.) 

Property  k 

If  we  have  certain  external  variables  and/or  outputs  of  gates  which 
are  not  fed  hy  gate  p  such  that  their  disjunction  e  satisfies  the  equality 
<J>  (g  0  e)  =  0,  then  we  can  eliminate  the  input  g  from  gate  p  after  con- 
necting  these  external  variables  and/or  gate  outputs  directly  to  gate  p, 
(Fig.  1.9)>  without  changing  the  output  function  of  gate  p.   Thus  one 
gate  (gate  i)  and  all  inputs  to  this  gate  are  eliminated. 


■>d£' 


Eliminate  gate  i 
and  all  inputs  to 
gate  i. 

(a)  (b) 

Fig.   1.9  If  we  have  certain  external  variables  and/or  outputs  of  gates 
whose  disjunction,  e,  satisfies  $  (g  0  e)  =  0  in  (a),  then 

XT 

we  can  eliminate  the  input  g  after  connecting  those  external 
variables  and/or  gate  outputs  to  gate  i,  as  shown  in  (b). 

Proof 

From  <2>  (g  $  e)  =0,  we  have  $  g  $  0  e  =  0,  which  is  equivalent  to  the 


10 


equality  $  g  =  $  e.  Therefore  a  replacement  of  g  by  e  does  not  change 


the  output  F  =  <J>  g  of  gate  p. 
P    P 


Q.E.D. 


We  can  easily  extend  this  property  as  follows.  Suppose  we  are  given  a  net- 
work in  which  a  gate  p,  a  subnetwork  o-,,   a  gate  r,  a  subnetwork  a^,   and  a 
gate  t  are  cascaded  as  shown  in  Fig.  1.10.   The  only  output  connection  of 
gate  i  is  connected  to  gate  p  as  input  g. 


(EH-^ 


Fig.  1.10  Gate  p,  subnetwork  a-,,  gate  r,   subnetwork  ap,  and  gate  t  are 

cascaded,  where  the  input  g  to  gate  p  is  the  only  output 
connection  of  gate  i. 


Let  us  define  two  functions  h  ,  and  e  ,   as  follows: 

pt      rt 


(i)  h  ,   =  F ,  0  F! 
pt     t    t 


(i.i0, 


where  F  is  the  output  of  gate  t  before  disconnecting  g  from  gate  p,  and 

F'   is  the  output  of  gate  t  after  disconnecting  g  from  gate  p.  The  function 

-£ 

h   is  the  same  as  (1.3).   (For  simplicity,  [g]  is  dropped.)   Recall  that 
pt 

the  true  input  vectors  of  h  ,  are  the  input  vectors  for  which  the  output 

pt 

of  gate  t  changes  after  disconnecting  the  input  g  from  gate  i.  Define 


(ii) 


'rt 


F  9   F; 


(1.5), 


where  the  F  is  the  same  as  the  one  used  for  h*  ,  and  F1!   is  the  output 


n 


of  gate  t  obtained  by  connecting  the  constant  1  (one)  to  gate  r. 


Fig.  1.11  If  e  satisfies  e   ^  e  =>  h  ,  ,  then  e  can  be  connected  to 

rt  —   —  pt 

gate  r  without  changing  the  output  of  gate  t. 


Property  5 

In  Fig.  1.11,  if  we  have  certain  external  variables  and/or  outputs  of 
outside  gates  such  that  their  disjunction  e  satisfies 

(1.6), 


h  ,   c  ec  e_, 
pt  -   —  rt 


then,  without  changing  the  output  of  gate  t,  we  can  eliminate  the  input 

g  from  gate  p  after  connecting  these  gate  outputs  and/or  external  variables 

(whose  disjunction  is  e)  to  gate  r. 


Proof 

Consider  a  true  vector  E  of  e  , .  Then  by  (1.5)  F.  $  F,   =0  since  e  -1  for 
E.   In  other  words  F,  =  F"  .   Thus,  even  if  e   or  e  (since  e c  e   )  is 
connected  to  gate  r,  the  output  of  gate  r  does  not  change.   Therefore  it 
suffices  to  prove  that  the  disconnection  of  g  from  gate  i  does  not  change 
the  output  of  gate  t  when  e  is  already  connected  to  gate  r.   For  this  pur- 

pose,  let  us  introduce  a  function  h   ,  similar  to  h  , ,  defined  by 

'  pr  '  pt'  J 

*         t 

h   =  F  0  F  ,  where  F  is  the  output  of  gate  r  in  the  original  network. 
pr    r    r         r 
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and  F'   is  the  output  of  gate  r  when  g  is  disconnected  from  gate  p  but  e 

is  not  yet  connected  to  gate  r.   Clearly  h   ^h  .  Now,  assume  that  e  is 

*  *  i    •*  _ 

connected  to  gate  r.   Using  h   ,  let  us  define  another  function  h   =  h   e. 

pr  '  pr    pr 

-*• 
The  true  input  vectors  of  the  function  h   are  the  input  vectors  for  which 

the  output  of  gate  r  changes  by  disconnecting  g  from  gate  "p.   Thus,  the  true 

input  vectors  of  h   are  the  only  input  vectors  for  which  the  output  of  gate 

t  might  change  by  disconnecting  g  from  gate  p.  However,  the  equality 

h'   *  h  .  =  0  holds  due  to  h   =  h   e  and  the  assumption  of  e  ^  h  ,  .   In 
pr    pt  pr    pr  —  pt 

other  words,  if  h*  =  1,  then  h\  must  be  0.  Therefore  those  changes  in 

'     pr    '  pt 

*t 

gate  r  corresponding  to  the  true  input  vectors  of  h   do  not  affect  the 

output  of  gate  t.  Q. E.D. 

Notice  that  e  ,  is  the  maximal  Boolean  function  which  can  be  connected 
rt 

to  gate  r  without  changing  the  output  of  gate  t  (Fig.  l.U). 

In  the  computational  procedure  which  will  be  presented  in  1.6,  we  im- 
plement the  following  special  three  cases  because  it  would  be  too  time- 
consuming  to  implement  general  Property  5.   Cases  A  and  B  are  special  cases 
of  Property  5,  and  case  C  is  an  extension  of  cases  A  and  B  (A  proof  is 
omitted  since  it  is  easy). 

Property  5  for  the  following  cases: 

Case  A:    r  =  p   (Fig.  1.12  (a)  ), 

Case  B:    r  =  t   (Fig.  1.12  (b)  ),  and 

Case  C:   a  combination  of  cases  A  and  B,  assuming  that  gate(s)  t  are 
the  output  gate(s)  of  the  entire  network. 


13 
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Fig.  1.12  (a) 


Fig.  1.12  (b) 


Case  A:  e  can  replace  g,  if  e  satisfies 
P  P 

-*        •* 
h   c  e  ce4  . 
pt  -  p  -  pt 


Case  B:  e.  to  gate  t  can  replace 
g,  if  e,  satisfies 

hPt  -  et  -  ett  ' 


Fig.  1.12  (c) 


Case  C:   e  and  e,  together  replace  g,  if  e 
p     t  P 

and  e,  satisfy  eve,3  h*  , 
t        p   t  —  pt 

e  c  e  ,  ,  and  e,  c  e, ,  simultaneously, 
p  —  pt       t  —  tt 


It  is  difficult,  if  not  impossible,  to  extend  Property  5  to  the  general  case 
where  some  gate-chains  from  gate  p  to  gate  t  do  not  contain  gate  r  (Fig.  1.13) 


K 


^ 


Fig.  1.13  Some  gate-chains  from  gate  p  to  gate  r  do  not  go  through  gate  r. 


Ik 


Alternatively,  let  us  investigate  Fig.  l.lU  as  a  special  case  of  Fig.  1.13. 
In  Fig  l.lU,  we  attempt  to  eliminate  g  "by  connecting  certain  gate  out- 
puts and/or  external  variables  to  each  gate  immediately  preceding  the  out- 
put gate(s)  of  the  entire  network.  We  call  this  case  Case  D  .   Let  gate 
r  ,  k=l,  . . . ,  a  denote  such  gates  immediately  preceding  the  output  gate  t 

which  are  fed  by  gate  p  directly  or  through  other  gates.  Let  F   denote  the 

rk 
output  of  gate  r,  ,   k=l,  . .  . ,  a,   and  let  3>.  denote  the  disjunction  of  inputs 

to  gate  t  from  outside  of  the  subnetwork  shown. 

e 


(iT^1.'-  - 


Fig.  1.1k     Case  D:   We  attempt  to  eliminate  g  by  connecting  e   to  gate  r 

k 
for  k=l,  . . . ,  ol,   respectively. 

Property  5' 

If  we  have  a  sets  of  certain  gate  outputs  which  are  not  fed  by  gate  p 
directly  or  through  other  gates,  and/or  external  variables  whose  dis- 
junctions e   ,  k  =  1,  . . . ,  a,   satisfy  the  following  conditions  simul- 

rk 
taneously; 
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h*   c  e    -  f   v/  <&.  ^ 
pt  —   r-  -   r..    t 


V  5  e    5  F   v  *t  )  (1.7), 


2      *2 


5*  "   ra  "   ra   * 

then  we  can  eliminate  g  after  connecting  e   to  gate  r  for  all  k=l,  . . . ,  a, 

k 
respectively. 

Proof 

Consider  an  arbitrary  vector  a  of  the  function  F   v  <£>,  .   Then  <£>  -1  or 

rfc    -c        t 

F   =1  holds  for  a.   Thus,  even  if  a  is  connected  to  gate  r.  ,  the  output  of 

rk  k 

gate  t  does  not  change  since  $,=1  or  F  =0  (Note  that  gate  r  is  a  NOR  gate). 

Xi  r,  k 

k 

Therefore,  even  if  e   such  that  e   c  F   s/  $,  is  connected  to  gate  rn  ,  the 
'  r,  r,  —  r,    t  k7 

k  k     k 

output  of  gate  t  does  not  change.  Now  assume  we  connect  e   to  gate  x  ,   for 

rk         k 

all  k=l,  ....  a.   Since  e   satisfies  h*  —  e    for  all  k=l,  ....  0;,  the 

'  \  Pt  -  rfc  '    '  > 

disconnection  of  g  from  gate  p  does  not  affect  the  output  of  gate  t,  as  is 
shown  in  the  proof  of  Property  5.  Q,. E.D. 


In  the  computational  procedure,  we  check  Case  D,  when  none  of  the 
cases  A,  B,  and  C  lead  to  the  disconnection  of  g.   Furthermore,  if  case  D 
does  not  lead  to  the  disconnection  of  g,  we  attempt  to  eliminate  g  by 
connecting  certain  gate  outputs  (which  are  not  fed  by  gate  p  directly  or 
through  other  gates)  and/or  external  variables  to  all  of  gates  p,  t,  and 
gate  r  ,  for  all  k=l,  ...,  a,  as  a  combination  of  Case  A,  Case  B  and 
Case  D.   We  call  this  case  Case  E. 
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Fig.  1.15  Case  E:   We  attempt  to  eliminate  g  by 
connecting  e  ,  e+,  e^  ,  . . . ,   e^  , 
s  imult  aneous ly . 


T  *'  V   '  ra 


l.k     Elimination  Of  Connections  By  Introducing  A  New  Connection 

Suppose  an  input  g  is  connected  to  a  subnetwork  a,   which  in  turn  feeds 
gate  t,  as  shown  in  Fig.  I.l6  (a). 


Fig.  1.16  (a)  An  input  g  is  connected  to  a  subnetwork  a 
whose  output  connections  go  to  gate  t. 


Property  6 


In  Fig.  1.16  (a),  if  g  implies  F  ,  the  negation  of  the  output  F  of  gate  t, 
then  the  new  network  configuration  of  Fig.  1.16  (c)  is  equivalent  to 
Fig.  1.16  (a)  with  respect  to  the  output  of  gate  t. 
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Fig.  1.16  (b)  An  intermediate  stage  of  the  reconfiguration 
of  Fig.  1.16  (a).  A  duplicate  g  is  added 
to  gate  t. 


Fig.  1.16  (c)  A  duplicate  g  is  connected  to  gate  t ,   and 
the  original  g  is  disconnected  from  the 
subnetwork  a. 

Proof 

Consider  an  arbitrary  true  vector  a  of  the  function  of  F  .   Then  F  =0 
for  this  a.  This  means  that  at  least  one  input  of  NOR  gate  t  assumes 
the  value  1.   Therefore  even  if  g  is  duplicated  at  the  input  of  gate  t 
(see  Fig.  l.lo  (b)),  the  output  of  gate  t  does  not  change  if  g  CF,. 

"0 

Uhing  Property  3,  we  know  the  input  g  which  is  connected  to  the 
subnetwork  a  is  redundant  with  respect  to  gate  t.  Q,.  E.D. 


In  the  computational  procedure  which  will  be  presented  in  Section 
1.6,   we  implement  Property  6  as  follows.   Consider  a  subnetwork  a   of  the 
entire  network  such  that  all  output  connections  from  a  go  to  only  one 
gate.   Let  gate  t  denote  this  gate.  Assume  that  a  has  an  input  g  for 


Ifl 


which  ~F  3  S  holds,  where  F  is  the  output  of  gate  t  (Fig.  1.17  (a)). 
Furthermore,  let  g.,  i=l,  . ..,  a,  denote  the  inputs  to  a,  if  any,  such 
that  each  g.  implies  g,  i.e.,  g  ^g..   Let  h  ,  j=l,  ...,  (3  denote  the 
inputs  to  o   other  than  g.  (Fig.  1.17  (a)). 


The  outputs  of 
the  network. 


(a)  A  subnetwork  a   of  the  entire  network  such  that 

all  output  connections  from  a  go  to  only  one  gate 
t,  and  that  a  has  an  input  g  for  which  F ,  ^  g  holds, 


7»The  output  F, 


(b)  The  part  of  the  entire  network  under  consideration 
where  F  =  g,  and  g  3  g  for  i=l,  . . . ,  a  hold. 


Fig.  1.17  Eliminating  connections  using  Property  6. 
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g  and  all  g. 's  are 


disconnected. 


subnetwork 
o 


(c)  This  configuration  is  derived  from  (b)  by 

(i)  connecting  a  duplicate  of  g  to  gate  t  and 
(ii)  disconnecting  g  and  all  g.'s  from  a. 


The  outputs 
of  the  networks 


(d)  The  entire  network  derived  by  replacing  (b)  by  (c). 


Fig.  1.17  (cont'd)  Eliminating  connections  using  Property  6. 
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In  the  above  configuration  (b),  first  connect  a  duplicate  of  g  to  gate  t, 
and  then  disconnect  g  from  cr.   Since  g^g.  holds  for  i=l,  . ..,  a,  we 
disconnect  all  g.'s  from  a,  by  using  Property  3.  Fig.  1.17  (c)  shows  this 
transformation,  and  Fig.  1.17  (d)  is  the  resulting  entire  network.   Clearly 
Fig.  1.17  (d)  has  cc-1  fewer  connections  than  the  original  network  of  Fig. 
1.17  (a).  Notice  that  when  a  has  no  g.'s  for  which  g  =>  g.  holds,  this 
transformation  does  not  yield  a  reduction  in  the  number  of  connections. 
But  we  will  derive  a  new  network  of  Fig.  1.17  (d)  of  the  same  number  of 
connections,  even  in  this  case,  because  the  new  network  has  a  different 
configuration,  so  that  it  can  be  used  for  further  redundancy  checking. 

1. 5*     A  Transformation  Which  May  Allow  The  Elimination  Of  Some  Connections 

Assume  we  have  a  network  configuration  as  shown  in  Fig.  1.18  (a), 
where     (i)  the  outputs  of  the  subnetwork  o   go  to  two  different  gates 
r  and  t, 
(ii)  the  output  of  gate  r  goes  only  to  the  third  gate  s, 
(iii)  the  output  of  gate  s  goes  only  to  gate  t, 
(iv)  gate  s  has  one  or  more  inputs  g  ,  gp,  ...,  g  other  than 
the  input  from  gate  r,  and 
(v)  the  disjunction  of  all  g.'s  implies  the  output  F  of  gate  t, 
i.e.,   Ft  fgi  vg2 ^g^  . 


*    We  do  not  implement  this  checking  scheme  in  our  current  computational 
procedure  which  will  be  presented  in  Section  1.6,  because  this  case 
appears  to  occur  only  rarely  judging  from  our  preliminary  experiments 
with  the  branch- and-bound  algorithm. 
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The  output  of 
gate  t. 


Fig.  1.18  (a)  A  network  configuration  which  satisfies  the 
assumptions  (i)  ~  (v). 


Property  7 

Given  Fig.  1.18  (a),  we  can  obtain  another  network  configuration  Fig.  1.18  (c) 

which  is  equivalent  to  Fig.  1.18  (a)  with  respect  to  the  output  of  gate  t. 


Fig.  1.18  (b)  An  intermediate  stage  of  the  reconfiguration 
of  Fig.  1.18  (a) 
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Fig.  1.18  (c)  A  network  configuration  equivalent  to  Fig.  1.18  (a), 
where 

(i)  gate  r  and  gate  s  are  eliminated, 
(ii)  the  output  connections  from  a  to  gate  r  are 
connected  to  gate  t , 
(iii)  two  new  gates  p  and  q  are  connected  in  series 
following  gate  r,  and 
(iv)  g  ,  .  ..,  g  are  connected  to  gate  p. 


Proof 

First,  let  us  make  a  double  negation  of  the  output  of  gate  t  by  connecting 
two  single  input  NOR  gates  p  and  q  in  series  after  gate  t.   Since  the  out- 
put, F  ,  of  gate  p  is  identical  to  F  ,  F  is  implied  by  g.  v  ..  v  g  due 
to  the  assumption  (v).   Therefore  we  can  connect  g^ ,  ...,  g  to  gate  p. 
This  results  in  Fig.  1.18  (b).   Using  Property  3  with  respect  to  gate  p, 
we  can  eliminate  all  g. 's  which  are  connected  to  gate  s.   After  an 
elimination  of  all  g.'s  from  gate  s,  gate  s  has  only  one  input  connection 
and  one  output  connection.   Therefore  we  can  eliminate  gate  r  and  gate  s, 
resulting  in  Fig.  1.18  (c).  Q.E.D. 
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Fig.   1.19*  shows  a  simple  example  of  the  transformation  of  Fig.   1.18. 
(After  applying  to  Fig.   1.19   (a)  the  transformation  of  Fig.   1.18,  we 
eliminate  the  input  g  to  gate  i  by  using  Property  3>  obtaining  Fig.   1.19   (b)) 


fe^<£> 


F=F. 


h>^ 


g 


"©~  F=I 


(a)  The  original  network  realizing 
F.  The  dotted  line  indicates 
the  subnetwork  o   for  this  case. 


(b)  A  new  network  realizing  the 
same  F.  The  network  has  one 
less  connection  than  the 
original  network  (a). 


Fig.  1.19  An  example  of  reconfiguration  explained 
in  Fig.  1.18. 


This  reconfiguration  was  first  found  by  J.  Culliney.  We  generalized 
his  finding  later,  resulting  in  Property  7. 
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1.6  A  Computational  Procedure  To  Attempt  To  Improve  Redundant  Networks 
By  Transformations 

Using  the  network  transformations  explained  in  Sections  1.1  through 
l.k,   we  implement  a  computational  procedure  to  generate  an  improved  net- 
work from  a  given  (non- optimal*)  network.   For  the  implementation  of  a 
practical  computational  procedure,  we  have  to  compromise  between  the 
complexity  and  the  power  of  the  procedure.  (An  excessively  complicated 
procedure  may  increase  the  total  computation  time  of  the  algorithm,  even 
while  lowering  the  cost  ceiling  substantially  by  finding  a  much  improved 
network. )  Thus,  instead  of  incorporating  all  of  the  ideas  in  the  previous 
sections,  only  simple  cases  are  incorporated.   The  principle  of  the  im- 
plementation is: 

(i)  to  attempt  to  eliminate  redundant  gates  first, 
(ii)  then  to  attempt  to  eliminate  redundant  connections. 
Let  us  first  present  the  segments  of  the  computational  procedure  which 

we  implemented. 

Part  I  (Replacement  of  the  output  of  a  gate  with  a  disjunction  of  other 
gate  outputs  and/or  external  variables.): 

Select  a  gate  p  which  is  not  an  output  gate  of  the  network.   Let  gates 
tf,  t",  ...,  denote  the  gates  to  which  gate  p  is  connected.   If  there  are 
certain  external  variables  and/or  outputs  of  gates  which  are  not  fed  (di- 
rectly or  through  other  gates)  by  gate  p  such  that  their  disjunction  is 


*    When  a  given  network  is  optimal,  some  transformations  may  yield  other 
optmal  networks. 
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identical  to  the  output  of  gate  p,  then  make  new  connections  from  these 
external  variables  and/or  gates  to  gates  t»,  t",  . ..,  and  remove  the 
existing  connections  from  gate  p  to  gates  t*,  t",  . ..,  along  with  all  in- 
put connections  of  gate  p.   By  this  transformation,  we  eliminate  one  gate, 
i.e.,  gate  p  (although  the  number  of  connections  might  be  increased). 

Part  II  (Elimination  of  a  gate  having  a  single  output  connection) 

Select  a  gate  i  which  is  not  an  output  gate,  and  which  has  only  one 

output  connection.   Let  gate  p  denote  the  gate  to  which  gate  i  is  connected. 

Check  whether  or  not  h   =  0  (h   is  defined  by  (1.  *0)  for  all  gates  t 

which  are  the  output  gates  of  the  network.   If  the  connection  _is  redundant, 

fi..e.,  h  =  0)  then  remove  the  connection.  By  this  transformation,  we  eliminate 
pt 

gate  i  and  its  inputs  and  output.   If  the  connection  is  not  redundant  (i.e, 

h  =£   0  for  some  t),  then  by  applying  Properties  5  or  5'  we  determine  if 
pt 

there  are  any  external  variables  and/or  outputs  of  gates  which  are  not 
fed  by  gate  p,  such  that  by  introducing  new  connections  from  these  ex- 
ternal variables  and/or  gates,  the  connection  of  gate  i  to  gate  p  becomes 
redundant . 

As  we  explained  in  Section  1.3,  the  detailed  checking  procedure  is: 
First  check  Case  A  (Fig.  1.12  (a)  ).   If  Case  A  does  not  eliminate  the 
gate  having  a  single  output  connection,  then  check  Case  B  (Fig.  1.12  (b)), 
Case  C  (Fig.  1.12  (c)),  Case  D  (Fig.  1.1*0,  and  Case  E  (Fig.  1.15), 
successively. 

Part  III- a  (Elimination  of  a  redundant  connection  of  a  gate) 

Select  a  gate  i,  which  is  not  an  output  gate  and  has  two  or  more 
output  connections,  or  which  is  an  output  gate  having  output  connections. 
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Determine  'whether  or  not  an  output  connection  from  gate  i  to  another  gate, 
p,  is  redundant  with  respect  to  the  output (s)  of  the  entire  network;  this 
is  done  by  checking  whether  or  not  h  =0  (h   [g]  is  defined  by  (1.3)), 
where  g  is  the  output  connection  under  consideration  from  gate  i  to  gate 

.v. 

p,  and  t  denotes  the  output  gate(s)  of  the  entire  network.   If  h   [g]  =  0 

pt 

for  all  output  gates  t,  then  remove  the  connection  g. 


Part  Ill-b  (Elimination  of  a  redundant  connection  of  an  external  variable) 

Select  an  external  variable  x,.   Determine  whether  or  not  the  connection 
of  x ,  to  a  certain  gate  is  redundant  with  respect  to  the  output (s)  of  the 

*    r      -\ 

entire  network;  this  is  done  by  checking  whether  or  not  h   LgJ  =  0, 

pt 

where  g  is  the  connection  (of  x,)  under  consideration  to  gate  p,  and  t 

denotes  the  output  gate(s)  of  the  entire  network.   If  h   [g]  =  0  for  all 

pt 

output  gates  t,  then  eliminate  the  connection  g. 


Part  IV  ( Elimination  of  redundant  connections  by  the  introduction  of  a 
new  connection) 

Select  a  portion  of  the  entire  network  which  consists  of  gate  t  and  a 
subnetwork  a,  where  the  outputs  from  a  go  only  to  gate  t  (Fig.  1.17(a)). 
When  an  input  g  to  a   satisfies  F  =>  g,  where  F  is  the  output  of  gate  t, 
derive  a  new  network  as  shown  in  Fig.  1.17.   By  this  reconfiguration  we 
eliminate  tt-1  connections.   (As  noted,  O-l  could  be  0.) 

Combining  Parts  I  through  IV,  we  complete  the  computational  procedure 
for  generating  an  improved  network  from  the  given  (non-optimal)  network. 
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2.   THE  BRANCHING  STRATEGY"!" 


2.1  Definitions 

Before  presenting  the  branching  strategy,  we  present  the  necessary 
definitions.   The  problem  is  to  find  NOR  networks  having  minimal  cost  for 
given  switching  functions,  where  the  cost  C  of  a  network  is  defined  by 
Ax  R+Bx  I  in  which  R  is  the  number  of  gates,  I  is  the  number  of  inputs 
to  gates,  and  A  and  B  are  arbitrary  non-negative  weights.   Suppose  the 
problem  is  to  obtain  the  optimal  networks  each  of  which  realizes  the  given 
m  output  functions  f.,  i=l,  . . . ,  m,  of  n  variables,  simultaneously.   The 
initial  solution  is  defined  by  a  set  of  m  gates;  each  gate  i  is  assigned 
the  output  function  f.,  i=l,  ...,  m. 

We  represent  the  output  of  a  gate  with  a  2  -tuple  of  0-1  variables 
]r,  as  (P  ,  ...,  P    ),  where  P  corresponds  to  the  j-th  input  vector 
for  j=0,  ...,  2   .  Notice,  however,  that  the  algorithm  will  not  imme- 
diately assign  a  definite  value  0  or  1  to  all  the  P^'s  of  a  gate,  so  a 

symbol  *  is  used  to  denote  an  unassigned  value  of  P^ .   The  output  of 

0        2n~l 
gate  i,  i=l,  ...,  m,  in  the  initial  solution  is  (f.,  ...,  f.    ). 

Let  us  consider  two  gates,  i  and  k,  in  a  NOR  network,  where  gate  i 

0       2n  1       0       2n  1 
is  connected  to  gate  k.   Let  (P.,  ...,  P.   )  and  (P.  ,  ...,  P    )  denote 

XX  ri  K. 

the  outputs  of  gate  i  and  gate  k,  respectively.   Because  the  gates  per- 
form a  NOR  operation,  the  outputs  of  the  gates  must  satisfy  the  following 
condition; 


f    The  concepts  used  for  making  our  branching  strategy  are  Davidson's 

[1,  2].   The  details  of  this  branching  strategy  are  discussed  in  [3]. 
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P?  =  0  for  all  d  such  that  F?  =  1 


F?  =  0  for  all  j  such  that  P?  =  1 
i  k 


A  similar  condition  must  hold  for  the  output  of  each  gate  in  a  NOR 
network  with  respect  to  each  of  the  connected  external  variables,  x.. 

When  the  output  of  a  gate  in  a  NOR  network  satisfies  the  above  con- 
dition with  respect  to  all  immediately  preceding/ succeeding  gates  and  all 
connected  variables,  we  call  this  output  a  feasible  assignment.  There  can 
be  unas signed  components  in  a  feasible  assignment. 

An  intermediate  solution  is  defined  as  a  network  of  R  gates,  R  >  m, 
where  the  outputs  of  the  first  m  gates  are  identical  to  those  assigned 
in  the  initial  solution;  the  outputs  of  other  gates  (gate  i  for  i=m+l, 
...  ,  R),  if  any,  are  completely  or  incompletely  specified;  and  the  out- 
put of  each  gate  i,  i=l,  ...,  R,  is  a  feasible  assignment. 

Consider  a  O-component,  P,   ,  in  gate  k  of  an  intermediate  solution. 
If  gate  k  has  at  least  one  input  (from  an  external  variable  or  another 

gate)  whose  jn-th  component  is  1,  then  P    is  said  to  be  covered. 

J0 
Otherwise,  P,   is  said  to  be  uncovered. 

'   k  

Our  algorithm  to  derive  an  optimal  network  generates  from  the  initial 
solution  an  intermediate  solution  in  which  all  the  O-components  of  all 
gates  are  covered.   To  facilitate  our  discussion,  we  introduce  the  con- 
cept of  possible  covers  for  an  uncovered  component: 

J'o 

A  possible  cover  for  an  uncovered  component  P,   =  0  in  gate  k  is  an 


external  variable  or  a  gate  which  satisfies  one  of  the  following  conditions: 
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(i)  An  external  variable,  x.  ,  which  is  not  yet  connected  to  gate  k, 

=  1. 
(2.1) 


^0 
and  which  has  x„  =1,  and  x^  =0  for  all  j  such  that  P  =  1. 


°0 
(ii)  A  gate  i  which  is  connected  to  gate  k,  and  P.   =  *  (unassigned). 

(2.2) 


(iii)  A  gate  i  which  is  not  yet  connected  to  gate  k,  whose  connection 
to  gate  k  will  not  form  any  loops,  which  has  P.   =  1  or  *,  and 


P?  =  0  or  *  for  all  j  such  that  P?  =  1.  (2.3) 

1  K. 

(iv)  A  gate  which  is  not  yet  incorporated  into  the  intermediate 

solution.  (This  is  called  a  new  gate. )  The  output  components 
of  this  gate  are  all  *  (unassigned),  and  this  gate  is  numbered 
R-fl,  when  the  given  intermediate  solution  has  R  gates.    (2.k) 

Consider  a  possible  cover  for  an  uncovered  component  P   =  0  in  gate  k 

K 

of  the  given  intermediate  solution  S.   We  cover  P   with  the  possible  cover 
by  the  following  implement at  ion  consisting  of  three  steps:   (Step  l)  If  the 
possible  cover  is  not  yet  connected  to  gate  k,  then  connect  it  to  gate  k. 
(Step  2)   If  the  jn-th  component  of  the  possible  cover  is  not  yet  assigned, 
then  assign  the  value  1  to  it.   (Step  3)  Assign  the  value  0  to  unassigned 
components  wherever  such  an  assignment  is  necessary  to  make  each  output 
assignment  feasible.   The  resulting  intermediate  solution  is  called  the 
augmented  intermediate  solution  of  the  given  intermediate  solution  S. 

Starting  from  the  initial  solution,  if  we  repeatedly  cover  uncovered 
components  in  intermediate  solutions,  we  may  eventually  obtain  an  inter- 
mediate solution  in  which  the  0- components  in  all  of  the  gates  are  covered. 
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We  call  such  an  intermediate  solution  a  feasible  solution.   Optimal 
solutions  are  feasible  solutions  having  the  least  cost  among  all  feasible 
solutions  of  a  given  problem.   To  enumerate  all  feasible  solutions  in  a 
systematic  way,  we  introduce  a  set  of  two  rules,  namely,  the  selection 
criterion  of  uncovered  components  (SCUC)  and  the  implementation  priority 
of  possible  covers  (IPPC)  as  defined  below. 

The  SCUC  is  the  criterion  under  which  an  uncovered  component,  P7=0, 

XL 

is  selected  to  be  covered  from  an  intermediate  solution. 

The  IPPC  is  the  criterion  under  which  the  order  of  implementation 
is  determined  among  the  possible  covers  of  a  selected  uncovered  com- 
ponent. 

We  call  the  heuristics  of  the  SCUC  and  the  IPPC  the  branching  strategy. 
In  order  to  obtain  a  'good'  branching  strategy,  let  us  introduce  more  de- 
finitions  in  the  following.   Examine  a  component  P   =  0  of  gate  k.   If 

K 

P.   =  0  is  covered,  then  Pn   =  0  is  said  to  be  of  type  COV.   For  an  un- 
it k  — — 

J0 
covered  component,  P   =  0,  of  gate  k,  types  of  possible  covers  are  defined 

as  follows . 

G-ate  i  which  satisfies    (2.2)    is   said  to  be  of  type  G*. 

External  variable  x„     which  satisfies    (2.1)    is   said  to  be  of  type  VC*. 

Gate   i  which  satisfies    (2.3)    is   assigned  one  of  the  following  four 
types   according  to  the  values  of  its   components: 

Type  GC*0,    if  P.      =  1,    and  F?    =  0  for  all  j   such  that   pJ  =  1;    Type  GC*0*, 

1,    and  there  is   at  least  one  ,j    such  that   F:    =  *  for  Pr    =  1; 
i  l  k 

Type  G*C*0,    if  P.°  =  *,    and  F?    =  0  for  all  j    such  that   pj  =  1;    Type  G*C*0 

J0  i  i 

if  P       =  *,    and  there  is   at  least  one  j    such  that   P.=*  for  Pr=l. 
l  ik 
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A  new  gate  of  definition  (2.4)  is  said  to  be  of  Type  NWG. 

Among  the  types  introduced  above,  we  define  a  desirability  order,  and 
then  we  define  the  types  of  uncovered  components,  and  the  types  of  gates, 
by  means  of  the  desirability  order. 

The  desirability  order  of  types  is  the  order  defined  by 

GOV  -  G*  -  VC*  -  GC*0  -  GC*0*  -  G*C*0  -  G*C*0*  -  NWG. 

(COV  is  the  most  desired) 
The  type  of  an  uncovered  component  is  defined  to  be  the  most  desirable 
type  among  the  types  of  its  possible  covers. 

The  type  of  a  gate  is  defined  as  the  least  desirable  type  among  all 
the  0- components  in  the  gate. 

2.2  Branching  Strategy 

Based  on  the  concepts  defined  in  Section  2.1,  the  branching  strategy, 
i.e.,  the  selection  criterion  of  uncovered  components  (SCUC)  and  the  im- 
plementation priority  of  possible  covers  (IPPC),  is  as  follows. 

If  the  current  intermediate  solution  contains  type  NWG  components, 
we  employ  Davidson's  special  scheme  called  'Remove  NF  Vectors'*,  which 
generates  from  the  original  intermediate  solution  with  type  NWG  components 
another  intermediate  solution  in  which  no  type  NWG  components  exist.   This 
scheme  is  to  choose  certain  type  NWG  components  to  be  covered  in  order 
to  maximize  the  number  of  new  gates  which  must  be  introduced  into  the 
network.   This  results  in  the  preclusion  of  some  equivalent  networks  with 
permuted  gate  labels.   For  details,  refer  to  [2].   Therefore,  we 


This  is  explained  in  [2],  as  'Special  Treatment  of  Type  NWG  Components. 
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assume  in  the  following  that  the  current  intermediate  solution  does  not 
have  uncovered  components  of  type  N¥G. 

The  SCUC 


If  the  current  intermediate  solution  has  uncovered  components  of  types 
VC*  or  less  desirable,  then  select  an  uncovered  component  with  the  fewest 
possible  covers,  among  those  whose  types  are  VC*  or  less  desirable.   If 
there  are  two  or  more  uncovered  components  which  have  the  same  least  num- 
ber of  possible  covers,  then  select  one  whose  type  is  the  least  desirable. 

If  the  current  intermediate  solution  has  only  uncovered  components 
of  type  G*,  then  select  an  uncovered  component  (of  type  G*)  which  has  the 
fewest  possible  covers. 

The  IPPC 

Implement  the  possible  covers  of  the  selected  uncovered  component 
according  to  the  following  order 

G*  -  VC*  -  {GC*0,  GC*0*,  G*C*0,  G*C*0*}+-  NWG. 

(The  possible  cover(s)  of  type  G*  are  assigned  the  highest  priority.) 

The  motivation  of  establishing  this  set  of  the  SCUC  and  IPPC  is  as 
follows : 

An  uncovered  component  which  has  a  smaller  number  of  possible  covers 
is  'hard  to  cover'  in  a  sense,  since  if  we  postpone  a  covering  of  this 
uncovered  component  until  later,  this  uncovered  component  will  most  likely 
lose  all  possible  covers  except  a  new  gate.   Accordingly,  we  might  miss 


+    The  possible  covers  of  types  GC*0,  GC*0*,  G*C*0,  and  G*C*0*  are 
assigned  an  equal  priority. 
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good  networks  in  the  early  stages  of  the  computation.  Therefore,  it  seems 
a  good  rule  to  first  cover  an  uncovered  component  which  has  the  fewest 
possible  covers  in  a  given  intermediate  solution.  However,  if  we  take 
simply  "the  fewest  possible  covers"  as  the  main  criterion  of  selecting 
uncovered  components  without  distinguishing  type  G*  components  from  un- 
covered components,  type  G*  components  could  be  selected  too  frequently 
at  an  early  stage  of  the  branching  steps.   Concentration  on  covering  type 
G*  components  may  likely  result  in  the  following  situation:   one  gate 
which  is  introduced  as  a  new  gate  to  cover  a  certain  component  of  another 
gate  realizes  the  negation  of  the  latter  gate.   With  the  repetition  of 
this  process,  we  may  create  an  indefinite  number  of  inverters  in  series 
without  realizing  a  feasible  network.   In  order  to  avoid  such  a  hazard, 
we  select  one  uncovered  component  with  the  fewest  possible  covers  among 
those  whose  types  are  VC*  or  less  desirable.   When  the  given  intermediate 
solution  has  only  uncovered  components  of  type  G*,  we  select  one  with  the 
fewest  possible  covers. 

Once  an  uncovered  component  is  selected,  we  cover  this  uncovered 
component  with  each  of  its  possible  covers,  generating  the  corresponding 
augmented  intermediate  solutions.   We  have  to  order  these  possible  covers 
in  order  to  generate  'good'  augmented  intermediate  solution  first,  i.e., 
one  which  is  as  close  to  a  feasible  solution  as  possible.   The  desirability 
order  defined  in  Section  2.1  seems  to  be  a  good  rule  for  this  purpose. 


3h 


2.3  Differences  of  Our  Branching  Strategy  From  Davidson's 
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The  branching  strategy  presented  in  Section  2.2  is  different  from 
Davidson's  in  the  following  three  aspects. 

(i)  Uncovered  components  of  type  1-COV. 

Davidson  classifies  uncovered  components  which  have  type  G*  possible 
covers  into  two  categories,  namely,  uncovered  components  of  type  1-COV, 

J'o 

and  uncovered  components  of  type  G*.   An  uncovered  component  P   of  gate 

Jo 

k  is  assigned  type  1-C0V  (a)  if  P   has  at  least  one  possible  cover  gate  i 
of  type  Q%   and  (b)  if  the  jn-th  component  of  every  gate  immediately  pre- 
ceding gate  i  is  0.   An  uncovered  component  which  has  type  G*  possible 

covers  none  of  which  satisfy  condition  (b)  above  is  assigned  type  G*. 

J0  J0 

Type  1-COV  P   has  the  important  property  that  covering  of  P   with  such 

K.  K. 

a  gate  i  does  not  introduce  any  uncovered  components  into  the  augmented 
intermediate  solution  (Fig.  2.1).   Accordingly,  when  an  intermediate 
solution  contains  only  uncovered  components  whose  types  are  1-COV,  this 
intermediate  solution  has  already  realized  the  given  output  function(s). 
Because  of  this  property  of  type  1-COV,  type  1-COV  uncovered  components 
need  not  be  covered  explicitly.   For  this  reason,  the  SCUC  is  applied 
only  to  the  uncovered  components  whose  types  are  not  1-COV,  in  Davidson's 
branching  strategy. 


-\-  Davidson's  strategy  discussed  in  this  paragraph  is  the  version  claimed 
by  him  to  be  the  best  among  a  total  of  eight  different  versions  of  his 
strategy.   For  the  details  of  his  strategy,  see  [1,  2]. 
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gate  k 


gate  P. 


(  o 


(  0 


gate  P„ 


)    (  0 


d0 
Fig.  2.1  An  example  of  uncovered  component  P,   of  type 

1-COV.   P   can  be  covered  by  gate  l  by 

setting  P   =  1,  where  setting  P.   =1  does 

K  1 

not  introduce  any  uncovered  components  into 
the  augmented  intermediate  solution. 


In  our  branching  strategy,  we  do  not  classify  uncovered  components 
having  type  G*  possible  covers  into  two  categories  as  Davidson  does.   Thus, 
programming  efforts  and  computation  time  which  are  spent  on  this  classi- 
fication in  Davidson's  approach  are  completely  eliminated. 

(ii)  The  selection  criterion  of  uncovered  components  (SCUC). 


Davidson  utilizes  the  desirability  order  as  the  main  concept  of  the 
SCUC.   In  order  to  improve  the  algorithm,  he  concentrates  on  ways  of 
distinguishing  uncovered  components,  by  introducing  several  finer  classi- 
fications of  types  of  their  possible  covers.   One  of  the  most  important 
concepts  to  obtain  these  finer  classifications  is  the  classification  of 
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of  type  VC*  possible  covers  into  "bad'  VC*  possible  covers,  and  'good'  VC* 
possible  covers.  A  bad  VC*  possible  cover  for  an  uncovered  component  P  =0 

•  K. 

of  gate  k  is  an  external  variable  x  -whose  covering  of  P   (i.e.,  connecting 
x  to  gate  k)  results  in  a  change  of  some  type  G*  components  in  the  immediatel 
succeeding  gates  to  a  less  desirable  type  (Fig.  2.2).  A  possible  cover  of 
type  VC*  which  is  not  'bad'  is  called  a  'good'  VC*  possible  cover. 


vr 


Jo         Ji 
p  p 

s  s 


gate  s   (J  (1  0  ) 


J0  Ji 

P  P, 

k 


gate  k  i         (   0  *   ) 

t 


J0  3± 

x  x  • 


«,  (  1     1  ) 

Fig.  2.2  An  example  of  a  'bad'  VC*  possible  cover  X.  . 
Suppose  x,  is  a  possible  cover  (of  type  VC*) 
for  P  .   Before  x«  is  connected  to  gate  k, 

h 

P   in  gate  s  is  of  type  G*.  However,  if  x, 
is  connected  to  gate  k,  the  type  of  P   is 
changed  to  a  less  desirable  type  because  P, 
becomes  0. 

Based  on  this  concept  and  several  other  properties  of  possible 
covers  of  types  G*  and  VC*,  he  classified  uncovered  components  of 
the  original  types  G*  and  VC*  into  seven  types: 
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g*/d,   vc*g*/b' >  g*/c,  vc*g*/a',  g*/a',  g*/b',  vc*a 

Ety  combining  the  above  classification  of  uncovered  components,  he  obtains 
'the  selection  order1  as  defined  by: 

g*/d-vc*g*/b'  -g*/c'  -vc*g*/a'  -g*/a'  -g*/b'  -vc*/a-g*c*o*-g*c*o-gc*o*-gc*o, 

where  G*/D  is  the  most  desirable.  (Definitions  of  uncovered  components  of 
types  GC*0,  GC*0*,  G*C*0,  and  G*C*0*  remain  the  same  as  ours.)  This  is 
the  main  part  of  his  SCUC.  According  to  this  order,  first  he  chooses  a 
gate  which  contains  uncovered  components  of  the  least  desirable  type, 
(if  there  are  two  or  more  such  gates,  he  chooses  the  one  with  the  smallest 
gate  number  in  the  case  where  the  least  desirable  type  is  one  of  GC*0, 
GC*0*,  G*C*0  or  G*C*0*,  otherwise  he  chooses  the  one  with  the  largest 
gate  number. )   If  this  gate  has  only  one  uncovered  component  of  the  least 
desirable  type,  then  it  must  be  chosen;  but  if  this  gate  has  two  or  more 
uncovered  components  of  the  same  least  desirable  type,  then  he  selects 
one  which  has  the  fewest  possible  covers. 

In  contrast  to  his  SCUC,  our  SCUC  employs  the  'fewest  possible 
covers'  as  the  main  criterion.   By  this  criterion  we  select  an  uncovered 
component  which  has  the  fewest  possible  covers  throughout  the  entire 
network.   When  a  tie  occurs,  we  apply  'the  desirability  order'  to  break 
it- 

(iii)  The  implementation  priority  of  possible  covers  (IPPC). 

Suppose  we  are  given  the  possible  covers  of  an  uncovered  component 
which  is  selectee  from  the  current  intermediate  solution.   Davidson 
determines  the  implementation  priority  of  possible  covers  by  using  the 
lower  bounds,  C's,  of  the  costs  corresponding  to  these  possible  covers, 
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where  C  for  each  possible  cover  is  calculated  as  follows: 

Li 

Let  S  denote  the  current  intermediate  solution,  and  let  P  denote  the 
uncovered  component  which  is  selected  according  to  the  SCUC. 


Take  a  possible  cover  of  P,  and  implement  it,  generating  the  augmented 
intermediate  solution  S'. 

If  S'  has  type  NWG  components,  then  introduce  appropriate  new  gates 
according  to  the  scheme  of  'Special  treatment  of  type  NWG  components' 
described  in  Section  2.2.   Rename  the  resulting  intermediate  solution 
as  S'  . 

Then  calculate  CT  using  the  formula 

C   =  A  X  f  the  number  of  gates  in  S'} 

+  BX  '  the  number  of  connections  in  S'} 

+  b  X  f  the  number  of  gates  whose  types  are  VC*  or  less 
desirable} . 

If  the  possible  cover  under  consideration  is  of  type  VC*,  reduce  C 

by  the  amount  of  A  +  B,  i.e.,  the  modified  C  =  the  original  C  - 

(A  +  B).1" 

In  our  version,  the  implementation  priority  of  possible  covers  is 
determined  by  a  simplified  desirability  order, 

G*  -  VC*  -  (  GC*0,  GC*0*,  G*C*0,  G*C*0*}  -  NWG 

In  summary,  the  difference  between  Davidson's  branching  strategy  and  our 
may  be  illustrated  schematically  in  the  following  way.   The  entire  searching 


+    This  treatment  has  the  purpose  of  assigning  a  higher  priority  to 
possible  covers  of  type  VC*  than  the  original  CT  indicates. 
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process  of  the  branch- and- bound  algorithm  is  represented  by  a  tree  (called 
a  search  tree)  in  which  the  root  node  corresponds  to  the  initial  solution 
of  the  problem,  and  non-terminal  nodes  and  terminal  nodes  correspond  to 
intermediate  solutions  and  feasible  solutions,  respectively.  Davidson's 
branching  strategy  is  based  on  minimizing  the  length  of  paths  from  the 
root  node  to  terminal  nodes.   Therefore,  the  search  tree  corresponding  to 
his  strategy  is  shallow  in  depth,  but  it  may  become  broad  in  width.  On 
the  other  hand,  our  branching  strategy  is  based  on  minimizing  the  number  of 
of  branches  originating  from  each  node.   Therefore  the  entire  search  tree 
corresponding  to  our  strategy  is  generally  thinner  in  width. 


i+0 


3.    COMPUTATIONAL  RESULTS 

The  entire  algorithm  [3]  was  coded  by  incorporating  the  redundancy- 
check  and  the  branching  strategy  discussed  in  the  previous  sections.   This 
computer  program  which  is  the  modification  of  Davidson's  algorithm  with 
our  branching  strategy  and  the  redundancy  check  procedure  is  called 
ILLOD-(NOR-B)  [k]. 

In  this  section,  we  compare  the  above  algorithm  with  Davidson's  by 
solving  problems  of  some  single  output  functions  and  multiple  output 
functions.   Since  his  program  was  written  in  the  CDC  l60k   Assembler,  we 
first  implemented  a  FORTRAN  program  according  to  his  strategy.   We  call 
this  FORTRAN  program  the  FORTRAN  equivalent  of  Davidson's  program.  Column 
(a)  of  Table  3>1  shows  part  of  his  results  taken  from  [l],  and  column  (b) 
shows  the  corresponding  results  by  the  FORTRAN  equivalent  of  Davidson's 
program.   We  note  that  both  programs  are  not  completely  identical  as  the 
discrepancy  in  the  number  of  backtracks  indicates.   But  such  a  discrepancy 
seems  unavoidable  because  of  the  following: 

(i)  Some  of  seven  finely  classified  types  G*/D,  VC*G*/B' >  G*/C, 
VC*G*/A'>  G*/A'7  G*/B',  VC*/A  are  not  clearly  defined  in  his  text  [1]. 
We  had  to  guess  the  details  to  give  a  consistent  definition  for  them. 

(ii)   In  order  to  break  ties  in  the  SCUC  as  well  as  in  the  IPPC, 
we  needed  more  detailed  rules  which  are  not  written  in  the  text.   An 
example  is  the  case  where  a  gate  has  two  or  more  uncovered  components 
whose  types  are  the  least  desirable  and  which  have  the  fewest  possible 
covers.   (in  the  FORTRAN  program,  we  choose  one  which  is  introduced 
most  recently  into  the  gate,  if  this  case  happens.)   In  the  rest  of  this 
section,  we  refer  to  this  FORTRAN  equivalent  of  Davidson's  program,  instead 
of  Davidson's  CDC  160^  program. 
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Notes  for  preceding  Table  3«1» 

Note  1.   All  problems  are  single  optimum  problems,  i.e.,  the 
program  searches  for  only  one  optimal  network  for 
each  problem.  No  fan- in  or  fan-out  restriction  is 
imposed. 

Note  2.   A  =  100  and  B  =  1  means  to  minimize  the  number  of 

gates  primarily,  then  to  minimize  the  number  of  con- 
nections secondarily,  and  A  =  1  and  B  =  0  means  to 
minimize  the  number  of  gates  only. 

Note  3-   Columns  (b),  (c),  (d)  and  (e)  are  the  results  for  the 

problems  for  dual  functions  of  Davidson's,  since  these 
programs  are  for  NOR  networks,  while  (a)  Davidson's 
program  is  for  NAND  networks. 

It  should  be  worthwhile  also  to  notice  the  difference  of  the  languages 
used  for  both  programs.   For  the  logical  design  program  by  the  branch-and- 
bound  algorithm,  coding  by  machine  instructions  seems  to  have  an  apparent 
advantage  over  the  use  of  FORTRAN  in  terms  of  the  efficiency  of  the  pro- 
gram.  For  example,  by  using  machine  instructions,  the  output  of  each  gate 
can  be  stored  in  a  few  (machine)  words  in  which  each  bit  represents  the 
output  component  for  an  input  vector.  Access  to  the  output  of  a  gate  during 
the  computation  (this  is  one  of  the  operations  most  frequently  used  in  the 
program)  can  be  performed  by  a  single  instruction.   However,  in  the  FORTRAN 
program,  each  output  component  of  a  gate  occupies  one  word.  Therefore,  the 
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equivalent  operation  is  completed  by  a  repeated  access  to  the  set  of  words. 

(The  more  the  external  variables  of  the  problem,  the  more  the  difference  of 

the  access  method  may  affect  the  efficiency  of  the  program. ) 

Before  running  ILLOD-(NOR-B),  we  experimented  two  more  programs,  the 

one  is  the  FORTRAN  equivalent  of  Davidson's  program  with  the  redundancy 

check  procedure,  and  ILLOD-(NOR-B)  without  the  redundancy  check  procedure. 

Columns  (c)  and  (d)  show  the  results  by  these  two  programs.   Finally,  we 

ran  ILLOD-(NOR-B).   The  result  is  shown  in  column  (e). 

Investigating  the  results  shown  in  columns  (b),  (c),  (d)  and  (e), 

let  us  discuss  the  difference  of  the  programs  in  the  two  aspects,  i.e., 

(i)  the  difference  in  the  branching  strategy,  and  (ii)  the  gimmick  of  the 

redundancy  check. 

(i)   In  the  first  aspect,  we  compare  the  computation  time  by  the 

FORTRAN  equivalent  of  Davidson's  program  (column  (b)  )  with  the 
one  by  ILLOD-(NOR-B)  without  the  redundancy  check  procedure 
(column  (d)).   The  result  is  that  the  latter  program  is  faster 
than  the  former  one,  except  for  one  problem  (Problem  III). 
The  improvement  would  be  greater  for  more  gates.   The  number  of 
backtracks  counts  generally  more  by  the  latter  program  than 
by  the  former  one.   This  is  due  to  the  difference  in  counting 
backtracks.   We  must  reduce  the  figures  by  the  latter  program 
by  about  ^0%   if  we  want  to  compare  them  with  the  corresponding 
figures  by  the  former  program  for  the  following  reason.   In  the 
ILLOD-(NOR-B)  without  the  redundancy  check  procedure,  the  cost 
lower  bound  C  corresponding  to  a  possible  cover  is  obtained 
from  the  cost  estimate  of  the  current  intermediate  solution 
plus  the  cost  estimate  of  possible  cover  under  consideration. 
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On  the  other  hand,  in  Davidson's  program,  the  cost  lower 

bound  C  is  obtained  from  the  cost  estimate  of  the  augmented  inter- 
Jj 

mediate  solution  corresponding  to  the  possible  cover  under  con- 

sideration.   Clearly  CT  appears  to  be  not  less  than  C  if  both 

Jj 

possible  covers  are  identical.   In  both  cases,  by  the  backtrack 
procedure,  we  search  for  an  unimplemented  possible  cover  whose 
cost  lower  bound  does  not  exceed  the  cost  ceiling  C.  When  we 
encounter  such  a  possible  cover,  we  increment  the  number  of 
backtracks  by  1.  Due  to  the  above  difference  of  the  value  of 
the  cost  lower  bound,  the  number  of  backtracks  by  ILLOD-(NOR-B) 
should  be  not  smaller  than  by  Davidson's  program,  assuming  that 
the  search  trees  by  both  programs  are  identical.   If  we  want  to 
make  the  counting  scheme  of  ILLOD-(NOR-B)  identical  to  Davidson's, 
we  count  1  only  when  we  obtain  a  new  augmented  intermediate 
solution  whose  estimated  cost  does  not  exceed  C.  In  ILLOD-(NOR-B) 
even  if  we  count  1,  the  corresponding  augmented  solution  may 
exceed  the  C  and  be  immediately  discarded. 

By  this  change  of  the  counting  scheme,  the  average  number 
of  backtracks  for  sample  problems  appears  about  ^0%   fewer, 
according  to  the  experiment.   (The  way  of  counting  backtracks 
has  nothing  to  do  with  the  efficiency  of  the  program  at  all. ) 

(ii)       In  the  second  aspect,  i.e.,  the  effect  of  the  redundancy 
check  on  the  improvement  of  computation  speed,  we  compare  the 
results  in  columns  (b)  and  (c),  and  also  the  results  in  columns 
(d)  and  (e).   For  some  problems,  the  gimmick  of  the  redundancy 
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check  reduces  the  computation  time,  but  for  some  other  problems, 
this  gimmick  does  not.   Clearly,  if  the  first  feasible  solution 
happens  to  be  optimal,  this  gimmick  does  not  reduce  the  com- 
putation time,  but  rather  adds  a  slight  amount  of  running  time 
spent  for  redundancy  check;   or,  even  if  the  first  feasible 
solution  is  not  optimal,  this  gimmick  will  not  reduce  the  com- 
putation time  if  the  total  amount  of  time  for  the  problem  is 
very  small.   For  many  of  the  above  test  problems,  these  situations 
happen,  thus  the  use  of  the  redundancy  check  procedure  is  not 
well  justified  from  the  above  results. 

In  order  to  experiment  the  algorithms  further,  we  took  some 
6-gate  and  7-gate  functions  of  four  variables.   Table  3*2  is 
the  statistics  of  these  functions,  by  using  the  above  four 
FORTRAN  programs.   For  6-gate  functions  of  four  variables, 
ILLOD-(NOR-B)  is  slightly  worse  than  ILLOD-(NOR-B)  without  the 
redundancy  check  procedure,  even  though  the  number  of  back- 
tracks is  reduced  by  about  10$.   But,  for  7-gate  functions  of 
four  variables,  the  redundancy  check  procedure  reduces  about 
20$  of  computation  time  from  20.33  seconds  to  16.37  seconds. 
Thus,  the  gimmick  of  the  redundancy  check  seems  to  improve  the 
computation  speed  for  those  problems  which  require  many  gates. 
Tables  3.3  ~  3.6  are  the  detailed  statistics  by  the  four 
FORTRAN  programs,  showing  the  computation  time  vs.  the  number  of 
true  vectors.   These  figures  are  plotted  in  Fig,   3*1  for  6-gate 
functions,  and  Fig.  3«2  for  7-gate  functions. 

One  thing  should  be  worthwhile  to  mention  about  the  statistics: 
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The  number  of  functions  experimented  are  83  for  6-gate  functions, 
and  k6   for  7-gate  functions.   But  the  FORTRAN  equivalent  of 
Davidson's  program  did  not  terminate  the  computation  for  one 
function  among  k6   7-gate  functions  in  700  seconds.   (The  best 
feasible  solution  found  so  far  still  contains  9-gates  and  18 
connections.)  In  order  to  take  the  average  of  computation  times, 
therefore,  we  excluded  this  function,  which  resulted  in  the 
statistics  of  ^5  7-gate  functions. 
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-* •-    FORTRAN  equivalent  of  Davidson's  program. 

-X- -  - -X-    FORTRAN  equivalent  of  Davidson's  program 
with  the  redundancy  check  procedure. 

-O O-   ILLOD-(NOR-B)  without  the  redundancy 

check  procedure. 

-A A-  -   ILLOD-  (NOR-B) 


number  of 
true  vectors 


12    13    14    15 
""no.  true  vectors 


Fig.  3*1  Computation  time  vs.  number  of  true  vectors 
for  6-gate  functions  of  four  variables. 


5k 


Xr 


X- 


FORTRAN  equivalent  of  Davidson's  program 

FORTRAN  equivalent  of  Davidson's  program 
with  the  redundancy  check  procedure 

ILLOD-(NOR-B)  without  the  redundancy 
check  procedure 


ILLOD-(NOR-B) 


number  of 
true  vectors 


Fig.   3.2  Computation  time  vs.  number  of  true  vectors 
for  7-gate  functions  of  four  variables. 
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Finally  we  experimented  functions  of  four  variables  which  require 
8  or  more  gates.   Since  these  functions  are  more  time-consuming  than  the 
previous  ones  we  tested  only  a  limited  number  of  functions  so  far,  and 
attempted  to  solve  mainly  by  using  ILLOD-(NOR-B).  Table  3*7  shows  the 
results.   In  Table  3«7.>  each  function  is  denoted  by  the  hexadecimal 
equivalent  of  a  l6-bit  binary  representation  (an,  a  ,  . ..,  anc)  >   where 
a.,  i=0,  . ..,  15,  are  the  coefficients  of  the  minterm  expansion  of  the 
function  f: 


f  =  aQ  x1  x2  x  x^  sy  a1  x^   xg  x  x^  n/  &2  x1  x^  x     x^  v  a  x^^  xg  x  x^  v 

...  v/  a15  x±   x2  x3  x^  . 


Because  of  a  limited  number  of  test  functions,  we  did  not  take  the 
average  of  the  computation  times  or  of  the  number  of  backtracks. 
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Table  3-7 
Follows 
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